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Large numbers of qualified s 


tudents do not apply to and enroll in college. Yet, earning a college degree is one of the primary 


pathways for economic success and is increasingly required for good jobs and high wages.' A number of programs and 


practices aim to improve coll 
Improvements in Graduation 


ege readiness and enrollment, including Take Stock in Children’s® (TSICS®) Facilitating Long-term 
and Higher Education for Tomorrow (FLIGHT) program. FLIGHT provides mentoring, scholarships, 


and additional support services to help disadvantaged middle and high school students stay on track for graduation, apply to 


college, ande 


semesters of college. This Wh 


nroll in college. 


FLIGHT students also have access to college transition and retention services in their first three 
at Works Clearinghouse (WWC) report, part of the WWC's Transition to College topic area, explores 


the effects of the FLIGHT program on student success. The WWC identified six studies of FLIGHT, and one study met WWC 


standards.’ 


What Happens When Students Participate in FLIGHT?? 


The evidence indicates that implementing FLIGHT: 
* may increase the number of students who enroll in college 


¢ may result in little or no increase in high school student attendance 


¢ may result in little or no increase in high school students’ GPA 


Findings on FLIGHT from the available research that meets WWC standards are shown in Table 1. For each student outcome 
reviewed by the WWC, an effectiveness rating, the performance of the FLIGHT intervention group relative to the comparison 
group, and the number of studies and students that contributed to the findings is presented. 


Table 1. Summary of findings on FLIGHT 


Average performance Evidence meeting 
(study findings) WWC standards (version 3.0) 
Number of Number of 
Outcome Effectiveness rating Intervention group Comparison group studies students 
9 9 
College access and enrollment Potentially positive effects 2% 83% 1 180 
enrolled enrolled 
F eho 4 12.37 12.45 
High school attendance No discernible effects decrees sichens ] 241 
. fs asl ; sieiied 3.90 3.95 
General high school academic achievement No discernible effects 1 240 
GPA GPA 
Note: Average performance values (study findings) are generated by one analysis conducted for each outcome, as reported by Philp (2005). These outcomes include enrollment in college the first 
semester after graduating high school (college access and enrollment), number of absences in the third year of the intervention (high school attendance), and weighted grade point average (GPA) 
in the third year of the intervention (general high school academic achievement). The effects of FLIGHT are not known for academic achievement or attendance in middle school; college readiness; 
staying in, progressing in, or completing high school; attendance, credit accumulation, or academic achievement in college; college degree attainment; and, labor market participation/success. 
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Based on findings from one study that met WWC evidence standards, the effectiveness rating for the college access and 
enrollment outcome is potentially positive effects, indicating that there is evidence of a positive effect with no overriding 
contrary evidence. The percentage of students enrolling in college in the fall following high school graduation was 97 for the 
FLIGHT group and 83 for the comparison group. This finding is based on 180 students. The effectiveness rating for the high 
school attendance and general high school academic achievement outcomes is no discernible effects. These findings are 
based on 241 and 240 students, respectively. 


HOW THE WWC REVIEWS AND DESCRIBES EVIDENCE 


The WWC evaluates evidence based on the quality and results of reviewed studies. The criteria that the WWC uses for evaluating 
evidence are defined in the Procedures and Standards Handbooks and the Review Protocols. The studies summarized in this report 
were reviewed under WWC Standards (version 3.0) and the Transition to College topic area protocol (version 3.2). 


To determine the effectiveness rating, the WWC considers what methods each study used, the direction of the effects, and how many 
studies tested the intervention. The higher the effectiveness rating, the more certain the WWC is about the reported results and about 
what will happen if the same intervention is implemented again. The following key provides a link between effectiveness ratings and 
the statements used in this report: 


Effectiveness Rating What Happened Statement Description of the Evidence 


Positive (or Negative) Effects The intervention is likely to change an Strong evidence of a positive effect, with 
outcome no overriding contrary evidence 


Potentially Positive (or Negative) Effects The intervention may change anoutcome Evidence of a positive effect with no 
overriding contrary evidence 


No Discernible Effects The intervention may result in little to no No affirmative evidence of effects 
change in an outcome 


Mixed Effects The intervention may result in positive or Evidence of inconsistent effects 
negative change in an outcome 


How is FLIGHT Implemented? 


The following section provides details of how FLIGHT was implemented. This information can help educators identify the 
requirements for implementing FLIGHT, and determine whether those implementation requirements would be feasible in 
their districts. Information on FLIGHT presented in this section comes from the study that met WWC evidence standards (Philp, 
2015) and from correspondence with the developer. Information on TSIC® was gathered from TS/C*’s website. 


¢ Goal: To help low-income middle school and high school students stay on track for graduation, apply to college, and enroll 
and succeed in college. 


* Target Population: To be eligible for FLIGHT, a student must (1) be in middle or high school grades; (2) be eligible for free 
or reduced-price lunch; (3) have a minimum 2.0 GPA and no Ds or Fs for the previous year; (4) be performing at grade level 
or above in reading and math as indicated by standardized testing; (5) have no out-of-school suspensions for the prior year 
and no more than six incidents of in-school suspensions for the prior year; (6) have no more than 10 unexcused absences in 
the previous year; and (7) be attending a public school. Students’ parents also must agree to adhere to TS/Cs® policies. 


« Method of Delivery: FLIGHT offers students individualized assistance and group 

workshops during the school day from volunteer mentors, student advocates, and, in Comparison Group: In the 

one study site, College Enrollment and Retention Specialists. one study that contributes 
to this Intervention Report, 
students in the comparison 
group had access to college 
preparation support that 
was already available in their 


» Frequency and Duration of Service: Students who continue to meet eligibility 
requirements can participate in FLIGHT for up to eight years, from grade 6 through 
the first three semesters of college. See Table 2 for details on the frequency in which 
individual service components were delivered. 


¢ Intervention Components: The FLIGHT intervention adds several components to the schools. 
TSIC® model, as noted in Table 2. 
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Table 2. Components of FLIGHT 


Key component FLIGHT 


Volunteer mentors Students meet with trained adult volunteer mentors in school for a minimum of 15 sessions per year for at least 30 minutes per 
session. These sessions typically focus on identifying needs, personal growth and development, educational planning, supporting 
academic success, and career planning. 


Student advocates/ —_ Every students assigned a student advocate, an adult /S/C staff member that serves as a case manager. The student advocate works 
case managers closely with volunteer mentors and school staff to make sure students are on track academically. FL/GH7includes more intensive 
academic, attendance, and behavioral monitoring than /5/C and includes: 
e College Access and Success Meetings to review progress toward graduation and college enrollment, one to four times per year for 
15-30 minutes each. 
¢ Advocacy Meetings to monitor students’ grades, attendance, and satisfaction with his/her mentor, four times a year for 15 minutes 
each. 
Student advocates address any academic or behavioral issues that arise by organizing meetings among teachers, guidance counselors, 
parents, and mentors. One FL/GHTstudy site also includes a College Enrollment and Retention Specialist who coordinated workshops 
and college tours. 


Florida Prepaid Students who fulfill AL/GH7 requirements receive a two-year scholarship to college, or they may use their scholarship funding to attend 
Scholarships vocational training. 

Continued Students have access to college transition and retention services in their freshman year of college. One FLIGHT study site includes a 
mentoring College Enrollment and Retention Specialist who coordinated post-graduation activities. 

Workshops FLIGHTadds workshops to the /5/@ model. Student advocates provide students (and parents) with workshops that cover a range of 


topics such as goal setting, study skills, and college preparation and applications. Students in grades 7-10 participate in three workshops 
per year, which last from one to four hours each. Students in grades 11-12 participate in six workshops per year, which last from one to 


four hours each. 
Student detail At the end of each school year, parents and teachers are provided a one-page snapshot of the student's grades, standardized test 
reports scores, attendance, office referrals, program participation, and whether the student is on track to graduate high school. 
What Does FLIGHT Cost? 


The cost of FL/GHTis not reported in the one study reviewed (Philp, 2015), and no cost information on FL/GHT was available 
on the 7S/C® website. However, the WWC identified a number of cost components from the intervention description in the 
study’s report. This preliminary list of costs is not designed to be exhaustive; rather, it is designed to provide educators an 
overview of the major cost components of implementing FL/GHT. 


Personnel Costs: Schools that implemented FLIGHT conducted one 2-hour mentor training, one 1-hour staff training, and 
nine hour-long workshops for staff each year. Student advocates/case managers were volunteers and required only training 
costs. Student advocates were hired by TS/C® and embedded within the school. 


Facilities Costs: Schools needed dedicated space to accommodate meetings between students and their mentors and 
student advocates/case managers during the school day. Space was also needed for workshops. 


Equipment and Materials Costs: Information on equipment and materials costs is not reported. 


Costs Paid by Students or Parents: Students and parents were responsible for transportation costs to workshops and for 
college costs not covered by the FLIGHT scholarship. 


In-Kind Supports: FLIGHT received in-kind services from volunteers and through private foundations and community agencies. 


Sources of Funding: College scholarships and student services were funded in a public-private funding model. FLIGHT 
received funding from corporate, foundation, and private donations, which were matched by the Florida Prepaid College 
Foundation funded by the Florida Legislature. 
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For More Information: 


About FLIGHT 
Take Stock in Children®, 3000 NE 30th Place, Suite 409, Fort Lauderdale, FL 33305 
Attn: Judy Saylor, Director of Program Growth and Innovation 
Email: jsaylor@tsic.org. Web: http://www.takestockinchildren.org. Phone: (786) 369-5130 


About the Study Reviewed 
Philp, J. D. (2015, October). FL/GHT: Final Evaluation Report. Columbia, SC: The Evaluation Group. 


Research Summary 


The WWC identified six studies that investigated the effectiveness of FLIGHT (Figure 1): 
¢ 1 study met WWC group design standards with reservations 

¢ 2studies do not meet WWC group design standards 

* 3 studies were ineligible for review 


Citations for all six studies are in the References section, which begins on page 8. 


Figure 1. Findings by outcome domain 


@) studies meet WWC 1 study meets WWC 2 studies do not 3 studies are 
standards without standards with meet WWC Tat-Vite fle) (-mcels 
reservations reservations standards review 


FLIGHT has potentially positive effects on college access and enrollment 


One study that meets WWC group design standards with reservations was determined by the WWC to show evidence of a positive 
and statistically significant effect of FLIGHT on college access and enrollment (Philp, 2015). 


FLIGHT has no discernible effects on high school attendance 


One study that meets WWC group design standards with reservations was determined by the WWC to show evidence of an 
indeterminate effect of FLIGHT on high school attendance (Philp, 2015). 


FLIGHT has no discernible effects on general high school academic achievement 


One study that meets WWC group design standards with reservations was determined by the WWC to show evidence of an 
indeterminate effect of FLIGHT on general high school academic achievement (Philp, 2015). 


The one study that meets WWC group design standards did not report findings on the following 11 outcome domains 
covered by the Transition to College Topic area: general middle school academic achievement, middle school attendance, 
college readiness, staying in high school, progressing in high school, completing high school, college attendance, credit 
accumulation, general college academic achievement, college degree attainment, and labor market. 
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Main Findings 

The following table shows the findings from one FLIGHT study that meets WWC evidence standards, and includes WWC 
calculations of the mean difference, effect size, and performance of the intervention group relative to the comparison group. 
Note that because only one study of FLIGHT meets WWC standards, the summary information for the outcome will match 

the individual study findings for that outcome. Based on findings from one study that meets WWC evidence standards, 

the effectiveness rating for the college access and enrollment outcome is potentially positive effects, indicating that there is 
evidence of a positive effect with no overriding contrary evidence. The relative performance of 89 means that 89 percent of 
the FLIGHT group can be expected to enroll in college at higher rates than the average comparison group student. This finding 
is based on 180 students. The effectiveness rating for high school attendance and general high school academic achievement 
outcomes is no discernible effects. These findings are based on 241 and 240 students, respectively. 


Table 3. Findings by outcome domain 


Mean 
(standard deviation) WWC calculations 
Intervention Number of Mean _ Effect Relative 

Measure (study) Study sample Sample size group Students difference size performance p-value 
College enrollment (%) 9" and 11" grade 180 students 97 83 0.14 1.23 89 01 
(Philp, 2015)? cohorts (4 and 2 

year follow-up) 
Outcome average for college access and enrollment across all studies B28 89 
Absences 7" and 9" grade 241 students 12.37 12.45 0.08 0.01 50 96 
(Philp, 2015)? cohorts (3 year (12.31) (11.04) 

follow-up) 
Outcome average for high school attendance across all studies 0.01 50 
Weighted GPA 7" and 9" grade 240 students 3.90 3.95 -0.05 = 0.05 48 58 
(Philp, 2015)? cohorts (3 year (0.91) (0.86) 

follow-up) 
Outcome average for general high school academic achievement across all studies -0.05 48 


Table Notes: For mean difference and effect size values reported in the table, a positive number favors the intervention group and a negative number favors the comparison group. The effect size is a 
standardized measure of the effect of an intervention on outcomes, representing the average change expected for all individuals who are given the intervention (measured in standard deviations of 
the outcome measure). The relative performance of the treatment group is a standardized measure of the effect of an intervention on outcomes. The value presented is Cohen's U3, derived from the 
effect size, and represents the expected percentile rank of the intervention group relative to a comparison group average at the SOth percentile. For example, a relative performance of 50 means that 
0 difference is expected from the comparison group on that outcome. The statistical significance of the domain average was determined by the WWC. Some statistics may not sum as expected due 
to rounding. 
For Philp (2015), no corrections for clustering or multiple comparisons and no difference-in-differences adjustments were needed. The adjusted intervention group mean and p-value presented 
ere were provided in response to an author query. This study is characterized as having a potentially positive effect on college enrollment because the estimated effect is positive and statistically 
gnificant. The study is characterized as having indeterminate effects on high school attendance and general high school academic achievement because the mean effect reported is not statistically 
gnificant. For more information, please refer to the WWC Procedures and Standards Handbook, version 3.0, page 26. 


“nus 
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In What Context Was FLIGHT Studied? 


The following section provides information on the setting and participants involved in the one study of FLIGHT that meets 
WWC evidence standards. This information can help educators understand the context in which the study of FLIGHT was 
conducted, and determine whether the program might be suitable for their setting. 


WHERE THE STUDY WAS CONDUCTED 


~~, study, 241 students in 42 middle and high schools in four districts in Florida 


1 urban district, 3 rural districts 


RACE ETHNICITY 


Minority White Hispanic Non-Hispanic 


FREE & REDUCED-PRICE LUNCH: 100% GENDER: 65% Female 35% male 


GRADES @ @ @ @ @ 4 400000000 


Grade 6—Postsecondary (PS) 


Details of Each Study that Met WWC Standards 


Research details for Philp (2015) 
Philp, J. D. (2015, October). FLIGHT Final Evaluation Report. Columbia, SC: The Evaluation Group. 


Findings from Philp (2015) show evidence of a positive effect of FLIGHT on college access and enrollment. The relative 
performance of 89 means that 89 percent of the FLIGHT group can be expected to enroll in college at higher rates than 

the average comparison group student. This finding is based on one outcome and 180 students. Findings on high school 
attendance and general high school academic achievement outcomes show evidence of indeterminate effects. These findings 
are based on one outcome per domain, with 241 and 240 students, respectively. 


Table 4. Summary of findings Meets WWC group design standards with reservations 
Study findings 

Average Relative Statistically 
Outcome domain Sample size effect size performance index significant 
College access and enrollment 180 high school graduates +1.23 89 Yes 
High school attendance 241 high school students -0.01 50 No 
High school general academic achievement 240 high school students -0.05 48 No 
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WWC evidence 
rating 


Setting 


Methods 


Study sample 


Intervention 
group 


Comparison 
group 


Outcomes and 
measurement 


Additional 
implementation 
details 


Meets WWC Group Design Standards With Reservations. This is a randomized controlled trial (RCT) with compromised 


random assignment, and the analysis did not account for unequa 


in one study site. Baseline equivalence of the treatment and comparison group is established.’ 


probabilities of assignment to the treatment and comparison groups 


The study took place in four Florida school districts (Broward, Highlands, Hardee, and DeSoto). Broward is a large urban county in 
ighlands, Hardee, and Desoto are rural counties in south-central Florida. 


southeast Florida, and H 


In February 2011, 315 students in grades 7, 9, and 11 in four Flor 
The study author randomly assigned 150 students to the FLIGHT intervention group and 1 


stratified by county and 


the total number of slots available. One student in a Broward high school was automatica 
by ISIC°, since they were the only eligible student to partici 


ida school districts were 


identified who met FLIGHT eligibility criteria. 
65 students to the comparison group, 


grade. In Broward, randomization was conducted separately within each school, in proportion to the total 
number of slots available. In the other three districts, randomization was conducted separately by grade and county, in proportion to 


ly assigned to a slot in FLIGHT, as requested 
pate within the school. Because one student was not randomly assigned 


to treatment and because the probability of random assignment was not controlled for in the analysis, the integrity of the RCT was 


compromised. One month following random assignment, t 


hree students randomly assigned to the intervention group were determined 


to be ineligible for FLIGHT and these students were replaced by randomly selecting three students from the comparison group to ensure 
that the intervention operated at capacity. 


In February 2011, 315 students in grades 7, 9, and 1 


in four Florida school districts were identified who met the 


following FLIGHT 


eligibility criteria: (1) they were in middle or high school grades; (2) the student must be eligible for the free and reduced lunch program; 


(3) the student must have a minimum 2.0 grade 
at grade level or above in reading and math as in 


for the prior year and no 


unexcused absences in the previous year; and (7 
TSICs® policies. In order to be eligible for the study, s 
period. Participants in Broward were drawn from 
Highlands, Hardee, and DeSoto were drawn from 


f£ 


0 


Students assigned to the comparison group did not receive the FL/GHT intervention and had access to co 


was already available in 


Study authors reported findings on three outcome measures that are eligible for review under the Transi 
ege access and enrollment domain) in the fall following hi 
11 cohorts of students. This outcome is binary and was obtained from the National Student Clearinghouse and TSIC’s® administrative 
records. The second eligible outcome was weighted GPA (general high school academic achiev 
year of the intervention. The third eligible outcome is attendance (high school attendance domain), whi 
Weighted GPA and attendance were reported for the grade 7 and grad 


first is college enrollment (col 


year of the intervention. 
grade, respectively. 


The study also examined the 


review under the Transit 


students applying for, 


being accepted to, and enrolling i 


their schools. 


ion to College topic area. 


dicated by standardized testin 
the student must be attendin 


80 
5 of the 11 middle schools an 


At baseline, the average age of students in the sample was 14.8 years, 65 perc 
percent were Hispanic. Just over one-third (37 percent) came from single pare 
price lunch, 54 percent were eligible to receive social services such as food stamps or 
high school graduate. Forty percent of students reported that they have (or had) a sibling enrolled in college. 


f the 55 middle schools an 


impact of FL/GHTon perceptions of barriers to postsecondary edu 


n college. The first co 


dance counselors. 


tion to College topic area. The 
gh school graduation for the grade 9 and grade 


ement domain), measured in the third 
ch is also measured in the third 
e 9 cohorts, at the end of 9th and 11th 


cation. This outcome is not eligible 


point average, and no Ds or Fs for the previous year; (4) the student must be performing 
g; (5) the student must have no out-of-school suspensions 
more than six incidents of in-school suspensions for the prior year; (6) the student m 
ga public school. The parents also 
tudents must have been able to be tracked between the app 
d 23 of the 39 high schools in 
dall 6 high schools in the three co 


ent were female, 80 percent w 
nt homes, all students were eli 
edicaid, and 78 percent had a mother who was a 


ust have no more than ten 


must agree to adhere to 
ication and enrollment 


the county, Participants in 


unties. 


minority, and 47 
e for free or reduced 


FLIGHT was implemented during three school years. The intervention included five components aimed at increasing the likelihood 
mponent was a pre-paid college scholarship for 
students who remained in good academic standing throughout high school. The second through fourth components were one-on- 
one mentoring from adult volunteers, intensive case-management services from school staff, and academic and college preparation 
workshops for students and their parents. The fifth component was a Student Detail Report of students’ grades, attendance, test scores, 
and status in the intervention that was provided at year-end to parents, teachers, and gui 


lege preparation support that 


f 


0 


= 


FLIGHT staff were trained to create and distribute the year-end Student Detail Reports. New mentors are provided with a 2-hour 
orientation and training session before being assigned as a mentor. New and returning mentors are also asked to participate in at least 
one 1-hour enrichment event during the year. These enrichment events are informal and can be in the form of a lunchtime online 
webinar or a mentor appreciation breakfast with FL/GHT staff. 
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Endnotes 
' Avery, C. (2013). Evaluation of the College Possible Program: Results from a randomized controlled trial. NBER Working Paper 19562. Cambridge, MA: 


ational Bureau of Economic Research. See also Hoxby, C. & Turner, S. (2013). Expanding college opportunities for high-achieving, low income stu- 
dents. Stanford, CA: Stanford Institute for Economic Policy Research. 


N 


The descriptive information for this intervention comes from Philp (2015). The What Works Clearinghouse (WWC) requests developers review the 
intervention description sections for accuracy from their perspective. The WWC provided the developer with the intervention description in January 
2018 and the WWC incorporated feedback from the developer. Further verification of the accuracy of the descriptive information for this intervention 
is beyond the scope of this review. 


w 


The literature search reflects documents publicly available by January 2018. Reviews of the studies in this report used the standards from the WWC 
Procedures and Standards Handbook (version 3.0) and the Transition to College review protocol (version 3.2). The evidence presented in this report is 
based on available research. Findings and conclusions could change as new research becomes available. 


4 As required by the Transition to College protocol (version 3.2), baseline equivalence must be established for an academic measure and a measure of 
socioeconomic status when an outcome has no natural pretest, and if these differences are within the adjustment range (i.e, greater than .05 and 
less than or equal to .25 of a standard deviation) baseline measures must be included in the analytic model. For the college enroll ment outcome, the 
WWC found that baseline equivalence between treatment and comparison groups was established on GPA and was within the adjustment range on 
socioeconomic status variables (eligible for social services and single-parent household). The author noted in the original study that a previous iter- 
ation of the analytic model was run that included a baseline control for social service eligibility. The results reported in this intervention report were 
drawn from this previous iteration of the analytic model, which the WWC obtained via an author query. 
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